DOCUMENT RESUME 



ED 308 259 



UD 026 804 



AUTHOR 
TITLE 



INSTITUTION 

SPONS AGENCY 

PUB DATE 

GRANT 

NOTE 

PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Garner, Catherine L. 

Educational Attainment: A Multi-Level Analysis of the 
Influence of Pupil Ability, Family, School and 
Neighborhood. 

Edinburgh Univ, (Scotland) • Centre for Educational 
Sociology. 

Economic and Social Research Council, Lancaster 
(England).; Scottish Education Dept., Edinburgh. 
Feb 89 

COO-28-0004; JHH-46-13 

36p.; Paper presented at the Annual Meeting of the 
American Research Association (San Francisco, CA, 
March, 1989). Small print may affect legibility. 
Speeches/Conference Papers (150) — Reports - 
Research/Technical (143) 

MF01/PC02 Plus Postage. 

Academic Achievement; ^Economically Disadvantaged; 
Foreign Countries; Influences; Neighborhoods; *Place 
of Residence; ^Poverty; Regression (Statistics); 
Secondary Education; ^Secondary School Students; 
Urban Demography; * Urban Youth 
^Neighborhood Characteristics; ^Scotland 



ABSTRACT 

This study tested for the existence of neighborhood 
effects on end of school educational attainment some 2,500 urban 
youth who left school between 1984 and 1986 in one educational 
authority in Scotland. Data were drawn from a student survey and from 
the United Kingdom 1981 Census of Population. A hierarchical linear 
regression model was used to test for neighborhood effects and to 
estimate the contribution of neighborhood deprivation to those 
effects. After controlling for pupil ability, family background, and 
school-level variables, the study found a significant negative 
association between deprivation in the home neighborhood and academic 
achievement together with additional neighborhood effects which could 
not be explained by the model. Statistical data are included on two 
tables and two graphs. A list of 41 references is appended. (FMW) 
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ABSlftACT 

This study tested for the existence of neighbourhood effects on end of school 
educational allsinmenl emong some 2,500 young peopie who ieft school between 
1984 and 1986 In one educationat authority in Scotland The study linlced survey data 
with area data from the UK 1981 Census of Population and used hierarchical linear 
regression modelling to test for neighbourhood effects and to estimate the 
contribution of neighbourhood deprivation to those effects Given control for pupil 
ability, family background and schooling the study found a significant negative 
asroclatlon between deprivation In the home neighbourhood and educational 
attainment together with additional neighbourhood effects which could not be 
explained by the models. 

The findings suggest that policies to alleviate e'ducatlonal disadvantage cannot be 
focused solely on schooling but must have a broader remit of tackling social 
deprivation In society at large 
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IMTRODUCHON 

A recent report to the Department or Education and Science in London by 
management consultants Coopers and tybrand states that V. there has been no 
definitive research which establishes a clear relationship between measures of 
deprivation and the need for educational resources" (Coopers and Lybrand 1988 para 
3 16) We believe that the study reported here provides Just that. 

One of the most intractable problems in the study of the relatlon^ship between 
deprivation and educational attainment has been the inability to disentangle the 
separate and joint effects of a large number of different factors influencing attainment, 
making up what the Plowden report In the 1960s aptly called *...that seamless web of 
circumstance (CACE. 1967) It is well known that pupils from socially deprived 
areas liave on average tower educational attainment than their counterparts from 
more advantaged areas (Coleman et at 1966; CAGE 1967; Rutter and Madge 1976; 
Rutter et aK 1979). What is not known Is the extent of the tf/rec/ effect of living In a 
socially deprived area over and above other factors of influence such as individual 
abihty. family circumstance and schooling In the present paper we have two aims. 
First we attempt to show whether there are area* or neighbourhood* effects on 
attainment and second we examine the Importance of multiple deprivation in 
contributing to any such neighbourhood effects 

Using data on some 2.500 young people who left school between 1984 and 1986 
in one education authority in Scotland, we examine the contribution of individual 
ability, family background, schooling and neighbourhood to young people's end of 
school attainment This study extends an earlier analysis based on school leavers from 
Glasgow schools in 1979/80 which showed that there was additional detriment to 
young people's attainment from living In areas of social deprivation (Garner 1988) 
The present study overcomes two imponant limitations which were indicated in that 
earlier study. First, we have a more fully specified model because we can include a 
measure of individual attainmeni at primary school This acts as a reasonable proxy 
4 
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for pupil ability. Second, we have used a multi-level modelling technique whicl) gives 
more accurate results than traditional methods In the analysis of hierarchical data and 
additionally permits the estimation of effects between levels. 

Neigh bourhoods and N9<flf)t>0MfhPo^ Effects 

Nelghbourtioods and neighbourhood effects can ba conceptualised In many ways. 
The neighbourhood has always been an Important unit of spatial aggregation for 
studying social interactions and the aetiology of social problems (Smith 1980). 
However, there Is no single, ready-made definition of what constitutes a 
neighbourhood. Neighbourhoods are not unl-dimenslonal. spatial units but vary in 
their definition depending on the type of problem to be studied, the supposed 
relationship between the neighbourhood characteristics and the phenomenon under 
study and the conceptualisation of the structural effects of neighbourhood. There Is 
evidence to show neighbourhood or locality effects on' such phenomena as urban 
crime and deviant behaviour (Herbert 1976), voting behaviour (Johnston 1976). morale 
of the elderly (Lohmann 1980; 8ohland and Herbert 1983). mental health (Smith 1980) 
and child abuse and neglect (Gabrino and Crouter 1978, cited In Smith 1980). 

Neighbourhood influences on educational attainment are likely to be through the 
social characteristics of the neighbourtiood rather than the physical environment, 
although It Is also likely that the residential environment will Interact with the social 
structure to confound Individual or family level Influences. The neighbourhood 
contextual effect on educational attalment can be supposed to result from a variety of 
processes as varied as individual personality development to buiit-5orm determinism. 
These influences can be divided broadly into three groups. First, psychological studies 
have shown that some types of residential environments are associated with particular 
personality characteristics, which may result In individuals responding differently to 
education depending on their environment (Butcher. Alnsworth and Neabit 1963; 
Moulden 1980). Similarly, education being essentially an Individual experience, is 
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^ thought to assume less Importance to Individuals who live In areas where adhereiice 

to group norms Is of overwhelming Importance in terms of social cohesion (Robson 
1069), Second, savaral studies have pointed out that the Interactions afforded by the 
local physical environment in terms of child-child, child-adult or even adult-adult 
contacts may Influence attainment through such factors as language development 
(Bemstein 1971), peer-group pressures (Keisall and Kelsall 1971) or the development 
of parental attitudes to education (Robson 1969). Third, economic pressures may be 
associated with poor health, material and experiential poverty and the pressure to 
leave school early. Although such economic pressures are essentially Individual or 
family Influences, the concentration of families suffering Individual deprivations In 
specific localities, such as run-down local authority housing estates. Is felt to 
predispose Individuals in those areas to fael a sense of futility and hopelessness. In 
relation to education, the Plowdcn report highlighted the problem of educational 
relevance to future life in areas of predominantly manual employment: 

In a neighbourhood where the lobs people do end the status 
they hold owe little to their education It Is natural for children as the/ 
grow older to regard school as a brief prelude to work rather than as an 
avenue to future opportunities (CAGE 1967, p. 50)'. 

These effects are all something more than just an aggregation of Individual 
characteristics. They are area effects. 

STUDY DESIGN: SPECnCATION AND MEIIfOOS 
In testing whother area effects exist through whatever mechanism, we must be 
severe In our specification of the model of Individual-level influences on attainment, 
A rigorous specification of the Individual-level model must be made to counter 
Hausefs argument that effects from groupings at a higher level are no more than 
artefacts of poorly specified Individual-level models (Mauser 1970). The data 
requirements and the methodology to produce such an adequate specification aie 
demanding. However, we can be guldad by recent scKool-effactlveness research 
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where thinking on these problems is most advanced A detailed discussion can be 
found In Willms (1967) but may be briefly summarised as follows First, because 
educational attainment is an individual characteristic. It Is essential to measure 
attainment at that level, to use aggregate and average outcomes could be misleading. 
Second, adequate control for 'intake" must be built Into the analysis *o reduce 
selection bias and to ensure that effects which any model may attribute to 
higher-level units, such as neighbourhoods, are not simply e consequence of the 
different types of Individuals within those units (Mauser 1970). Third, conceptual and 
statistical models must allow for the multi-level structure of the real world and the 
relational nature of that structure (McFherson end Willms 1986). Data limitations have 
frequently resulted In an abandonment of the first two principles although we are able 
to meet both requirements in the present-study The third principle however, is one 
which hes only recently become tenable with the development of software to permit a 
multi-level statistical analysis of large data-sets. 

Although conceptual models have recognised the multi-level structure of society 
for many years (Biau 1960, Byrne, Williamson and Fletcher 1975; Ebrlng and Young 
1979) the statistical software to estimate such models has orly become available 
since the mid-1980s. Multi-level regression Is e relatively new approach In the 
modelling of social data. It Is similar to an analysis of coveriance (ANCOVA) but 
where ANCOVA typically has a small number of treatment gioups, multi-level 
modelling cai acrommodate hundreds of higher-level units. Multi-level variance 
components analyses have been extensively usod In the natural sciences (Robinson 
1967) but within the social sciences, educational research has provided the main 
thrust for development (A'tkin and Longford 1986; Goldstein 1986, 1987; Raudenbush 
and Bryk 1966; Willms 1967, 1986). The stimulus for development In educational 
research comes from the fact that key Independent variables are often measured at a 
higher level of aggregation than the outcome variable of Interest For example, an 
important reseerch question mby be how pupil attainment Is affected by school-level 
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expenditure. The current software wes developed because of an awareness of the 
limitations imposed on the analysis of multhievel data by inappropriate methods 
(Bursteln 1980) and the restriction on data-set size imposed by readily available 
packages (Aitfcen and Longford. 1986) 

These hierarchical modelling programs make three important contributions to the 
analysis of social-scientific data with a nested structure. First, because these models 
explicitily recognise the clustering of Individuals within higher-level units, such as 
schools, they avoid violating the assumption of independence of observations which 
traditional OLS analysis commits in analysing hierarchical data. Sacond. hierarchical 
models are powerful in estimating cross-tevel effects Because they can model the 
outcomes o! the lower level, (within-unii) model by variables at a higher level, they ^ 
can assess the influence of higher-level variables not only on mean outcomes at the 
higher level (the intercepts of the within-unii models) but also on the structural 
relationships between the outcome variable and lov/er^level background variables (the 
slopes of the within-unit models). For example this ability allows us to assess how 
the level of school expenditure affects mean attainment in the school, and how it 
affects say the relationship between social class and attainment within schools Such 
a model would be able \o assess the success of compensatory policies for the most 
needy pupils in schools Third, hierarchical models can partition the variance between 
levels and can statistically separate the parameter or 'true' variance in the slope 
parameters of the within-unit model from sampling variance. Not only does this allow 
us to estimate the contribution which schools make to pupil attainment but this has 
significant implications for the estimation of higher-level effects These effects have 
frequently been dismissed in studies as being unimportant because they may explain 
only a small amount of the observed variance However, if the 'otal observed variance 
contains a large amount of sampling variability which is essentially unexplainable. we 
Should be estimating only the proportion of true or parameter variance which can be 
explained by higher level factors and this might be considerable 
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STUDY DESIGN: DATA SOURCES 

The data used in this study come from four sources. The individual and family 
background characteristics com^ from e <)5 per cent sample survey of pupils in on« 
Scottish education authority who were in their last compulsory year of schooling (S4) 
in the session 1983-84. This survey Is one of a series of surveys of young people 
(Scottish Young People's Surveys) conducted by the Centre for Educational Sociology 
at the University of Edinburgh In conjunction with the Scottish Education Department 
and other funding bodies. Additional individual level attainment measures were 
obtained from the Education Authority (EA) providing a measure of pupil attainment 
prior to entry to secondary school. Scottish Certificate of Examination (SCE) results 
for the two years of non-compulsory schooling (SS and S6) were obtained from the 
Examination Board, 

The fourth source of data Is the 1981 Census of Population.^ Data at the level of 
the enumeration district (ED) were combined Into a deprivation score «s devised by 
the Housing and Urban Renewal Research Unit of the Scottish Development 
Department (Duguld and Grant 1983). This score and neighbourhood membership 
were allocated to Individuals through the pottcode of their home address (Garner 
1984). 

The data set was restricted to Include only those young people who were living In 
EDs in urban areas. The urban categorization is defined as those EDs which are In 
continuous urban areas of over 10.000 people as defined in the 1981 Census. The 
focus on the effects of urban neighbourhoods and their level of deprivation was felt to 
be iustifiiid. given the different nature of deprivation In urban and rural areas (Shaw 
1979). This difference can be seen in the average scores on the deprivation Index 
which range from -0.44 in rural areas to -0.12 in urban districts of the present study 
area (the more positive the deprivation score the more deprived the area). 

The resultant data set Is however problematic for multi-level analysis because of 
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Its n on 'hierarchic fit structure. Neighbourhoods (EDs) can send pupils to more than one 
school and because at present the software requires a strict hierarchy where 
neighbourhoods, schools and individuals would nest one within the other, without 
crossing £>etweert levels, we had to adopt an alternative working strategy to allow us 
to proceed with the analysis. The best solution to this problem would be to 
cross-classify neighbourhoods and schools but the software. Is only currently being 
developed to allow this cross-classified analysis for large data sets (Goldstein 1967). 
The most practical solution was to restrict the analysis to two-levels (see below) with 
a final data set of some 2,500 individuals, 17 schools and over 500 neighbourhoods. 
Two sets of analyses were conducted on thaaa two -level datasets. First, a series of 
models were fitted taking neighbourhood as the higher-level unit and including school 
membership at the Individual level. Second, a series of models whh schools as the 
higher-level units and neighbourhood deprivation scores at the Individual level, were 
also fitted. 

MEASURES AND DEFiNITfONS 
The outcome measure Is a general attainment score at completion of secondary 
school. The scale hasM4 categories describing the number of O-grade and Higher 
SCE awards at the A to C level. Awards on the range A-C ere officially recognised as 
passes on the SCE Highers examination. For pupils obtaining no A to C. O-grade 
awards, account was taken of any SCE O-grade awards at the 0 or E grede. This 
variable captures both attainment and length of schooling since Highers cannot be 
taken until fifth or sixth year, that Is in the first or second year of non-compulscry 
schooling. This variable was scaled using a loglt transformation for re-expressing 
grades (see Wiiims 1986). 

The Independent variables were chosen partV to replicate, but also to extend 
earlier analyses (Garner 1066). The spacincatlon of the model at the individual pupil 
level was made as full as possible to construct the most stringent test feasible on the 
contribution of neighbourhood and neighbourhood deprivation The most important of 
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these personal/family variables are the prior-attainment measures These variables fill 
an Important gap in the earlier analysis of Glasgow school leavers. 

indiylduaLMeasures 

The prior- attainment measures were obtained from the EA Two test results are 
included here, a measure of verbal reasoning ability (Godfrey Thomson Unit 1973) and 
a test of reading ability These are outcome measures on tests administered to all 
pupils aged between eleven and twelve years In EA primary schools.^ The variables 
are standardized and centred around the mean for the study area prior to the analysis. 
These measures are themselves educational outcomes, therefore as well as measuring 
innate ability, they will capture some of the influence of family, school and 
neighbourhood which have been brought to bear on a child's educational performance 
up to the time when the tests were administered. Without such measures In the 
model we would be In danger of not controlling for selection bias in the higher level 
unhs. However, by including them we are certainly underestimating the rc^r^/ effects 
of family, school and neighbourhood influences. Given this control in our model, the 
educational outcomes which we are predicting represent only the progress In 
educational performance which occurs in secondary school between the age of eleven 
or twelve and the end of compulsory schooling Such an outcome Is crucial if the 
focus of the study is the effectlvenesie of secondary schools. However our control of 
prior-attainment is perhaps too stringent a control for an analysis of the effect of 
neighbourhood deprivation or family circumstances since it effectively restricts 
conclusions about it\n influence of these background factors to the four or so years of 
secondary schooling. 

The only other data measured unambiguously at the level of the individual is sex 
of respondent. This is coded zero for males and one for females and provides 
another important Individual-level control varlsble, 
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Family ch«ract«rlstlcs which ara taken hare lo be individual characteriillci are In a 
sense, wrongly attributed to that level since they are mora correctly properties of the 
group of individuals which make up tha family and could therefore be taken to 
constitute another level in the model. There are six family measures Included in our 
models In the present study. First, father's occupation, which acts as a proxy for 
social class, is scaled on the Hope- Goldthorpe scale in conjunction with the Registrar 
General's social cla&s Index (WiUms 1986) Length of parental schooling is represented 
by two dummy variables. These are proxy measures for the level of parental 
education. They are scaled one for mothers and fathers who stayed on at school 
beyond 15 years and zero for those who left school at age 15 or earlier or If this 
Information Is missing or unknown A discioiu Interval level variable represents family 
size as a count of the number of siblings for each respondent. It has a rang* of zero 
to nine with missing categories excluded from the analysis. Two dummy variables 
(srdled one/zero) indicating membership of one-parent families and whether fathe'^'s 
employment status was non-employed were also included. All family variables were 
centred around their respective study-area n.eans before the analysis. 

Theue family variables, particularly social class and parental education are 
conceptually problematic and their validity as 'true measures' can be questioned, 
Howevei, as indicator measures they are both powerful and essential to any well 
specified model of filial attainment. 

The restriction of the study to urt)an areas reduced the 20 EA schools In the study 
area to 17. In the first set of models where neighbourhood forms the higher-level 
unit of analysis the schools arb represented by a set of dummy variables. These 
dummy variables represent school membership and therefore capture all the varia*ion 
associated with schools whether attributable to processes within the schools or 
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through their contaxlual affect. School contextuel effects era widfSy dlscuasad 
elsewhere (Wiilms 1985; 1986) but can be summarised es the affect v^hich tha pupil 
membership of e school hss on en individual pupil's educational attainment. Glvan 
the smell number of Individueis in each neighbourhood (sea below) it is impossible to 
fit all the school durnmy variables and tha pupil background variables. To reduce tha 
number of variables, schools were clustered into sU groups by fitting a 'schools-only* 
model and grouping schools together using a clustering algorithm based on their 
unconditional relationship with tha outcome variable. 

Because these school dummy variables era baing fitted at tha leval of tha 

Individual in our neighbourhood models, they will polemially caplura pan of tha 
neighbourhood effect and part of tha affect of neighbourhood deprivation. School 
catchments and neighbourhoods have a degree of co-linaarity bacausa of tha 
essentially local nature of a school's catchment. Tha overlap batwaen school and 
neighbourhood Is difficult to dlser.tang'^ in our two-lav«l models and fitting the 
school variables as individual characteristics will absorb the variation which may ba 
Jointly attributed to schools and neighbourhoods. This means that tha neighbourhood 
effects and tfie affect of neighbourhood deprivation may tend to be .under estimated in 
the neighbourhood models where wa Include tha school variables. In the models 
where schools constitute the higher-level unit of analysis, neighbourhood deprivation 
will potentially capture part of the school-contextual effect and therefore wa may tend 
to Overestimate the effect of deprivation. Tha ad(:ilion of neighbourhood deprivation 
as an *individuahlever characteristic in the school-level models will however control 
only for level of deprivation, it will not be able to capture any neighbourhood effects 
which are not related to deprivation, these are likely to become absorbed into thfi 
school effects. 
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Nalqh bourtiood M<tsMr »s 

Nel0hboufft)oods trt reprtsenttd by EDt from th9 1961 Census of Foputailon. 
Although EDs havt •ntlraly trbitrary tpatUI boundarlts as far as t ducational outcomes 
trt conctrntd« btcaust wt havt no firm a priori deffnlKon of tht spatial unit which 
constititttt t ntlghbourhood H It peihaps preferabit to ust spatial data In ^ht most 
mlnlmtlly aoor*Oat«<l form avalltblt. Aggregation of spatial data reduces variability 
through averaging end obscures real world differences. Analyses with different 
eggregttlont of the seme spatlel date can produce very different results (Openshaw 
end Teytor 198 IK therefore we mutt be cautious to choose a tpaiial unit which 
represents e reasonable areal scale fw the processes which we think might be at 
I work. Our Ideas of how area effects might Influence att^hment would lead us to 

choose e neighbourhood of a slightly larger spatial m\% man an ED. EOs contain 

I 

j only 150-200 households end are likely to be too smalt to represent the type of area 

! effects which we hypothesize. However, n Is well known that ecological correlations 

I generally become weeker the smaller the areal grouping examined, which means thet 

by choosing EDs we ere again constructing stringent testa for neighbourhood effects 
. end the effect of neighbourhood deprivation, n we can Illustrate effects using this 

I small-scale neighbourhood unit H should make us more confident In the validity of 

our results. The schooMevel analysis will provide e further test of the validity of our 

findings wHh respect to deprivation. 

EDs therefore are taken to form the higher-level units in the first set of analyses 
end additionally each ED Is allocated a deprivation score based on an algorithm 
! devised by the Urban Renewal Research Unit of the Scottish Development Department 

, j (Ouguld and Grant 1983^ This score Is e comblnaiiun of twelve variables from the 

I 1961 Census of Population (Table y). The most heavily weighted constituents of the 

Index ere: unemployment youth unemployment single-parent families, low-eamlng 
socio-economic groups, overcrowding and the percentage of per,.)anently sick. This 
comblnetlon provides e sensitive measure of the level of disadvantage In the home 
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neighbourhood and permits an esilmaiion of the Influence of social deprlvaiion, as 
disiinci from any other neighbourhood effects, on educational attainment. The score 
Is designed to have a mean of zero and a standard deviation of one for the whole of 
Scotland. The present study area has a mean deprivation score of -0.106 with a 
standard deviation of 0.620. This means that the urban areas of this education 
authority are less deprived than the average for Scotland and have a narrower range 
(I.e. are more homogeneous) than the country as a whole. In the analysis performed 
at the school-level It \9 this deprivation score which provides the only representation 
of neighbourhood, although a mean deprivation score for each school's catchment 
provides an additional school-level variable. 

METOOD AND ST1UTEGY FOR AI«ALVSIS 

Both sets of analyses use the HLM program (BryK Raudenbush. Seltzer & Congdon 
ig86) to fit a series of mutil-levet models. This program represents en hierarchical 
two-level model by two equations which are estimated simultaneously, the withln-unit 
and the between-unit equations. The first withln-unlt model here, regresses Individual 
educational outcomes on prior attainment sex. family background and schooling 
variables within each neighbourhood, while the between-unit model, at the 
neighbourhood level, models parameters (Intercepts and slopes) from the wlthin-unlt 
equations as e function of ihe neighbourhood deprivation score. 

In the second series of models where school forms the higher-level, the 
withln-schoot model includes identical individual-level variables to the neighbourhood 
model together with the deprivation score for each Individual's home neighbourhood 
as an Indlvlduat-ievet characteristic. The between-school models Include contextual 
variables aggregftied up from Individuals to give mean school characteristics. 

Following the notation of Raudenbush and Bryk (1986) the within-unlt pupli level 
model for neighbourhoods can be written; 
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wherd 

Y,^ Is tha •ducatlonal outcome for individual i (1 » 1 .... in neighbourhood j (j » 1 .. 
J). 

there are k-l k-l independent variables which represent the individual's 

characteristics, and family background variables and school membership; 
Bjk are the withln-neighbourhood regression coefficients; 

ft,^ is the random error term or unique contribution of each Individual I in 
neighbourhood j. 

The betv/een-unlt model (ie neighbourhood level) can be written: 
where 

6^0 Is an estimate of how well a young person with average individual, family and 
school characteristics performs in each neighbourtiood or In other words an estimate 
of the variation between neighbourhoods in their adjusted levels of performance. 
D is the deprivation score for each neighbourhood; 

6o) is the regrr sion coefficient for the effect of neighbourhood- deprivation on the 
adjusted neighbourhood attainment; 

is the neighbourhood-level error term (p^^sterlor means) or the unique contribution 
of each neighbourhood - the neighbourtiood effect. 

Additionally we could write further neighbourhood-level regression equations 
which model each of the remaining withln-nelghbourtiood regression coefficients as a 
function of the neighbourhood deprivation score If the slopes were allowed to vary 
between neighbourhoods The school-level models have similar notation. 
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ANALYSIS AND RESULTS 

N elQhbourtiooJ Models 

Table 2 presents a summary of the series of neighbourhood HLM models fitted to 
the data on educational outcomes. The first model fits only an overall constant to the 
data. This U equivalent to performing a random effects analysis of variance and 
allows us to calculate how much of the variation in Individual educational outcomes 
lies between neighbourhoods. ^ 'n the present study 16 per cent of the unconditional 
variation In educational outcomes Is between neighbourhoiods. This is the variatlcr. b 
attainment between neighbourhoods before controlling for any Individual background 
variables. 

Model 2 fits a constant plus the Individual and family background characteristics. 
All variables are fitted as fixed effects which means that their relationship to 
attainment Is constrained to be the same (ie. the slopes are identical) for each 
neighbourhood. Exploratory analyses showed little heterogeneity In the slopes of 
background variables on attainment between neighbourhoods. Because we are 
essentially focusing on ^he 'nelghbourtiood' effects while controlling for other factors 
of influence on attainment It Is quite appropriate to fit these variables as fixed effects. 
This model explains some 32 per cent of indivldifat variation in educational outcomes 
and virtually all the true (parameter) variance In educational attainment between 
neighbourhoods. However, that left unexplained by Individual characteristics remains 
statistically significant and although the remaining variation appears to be a small 
amount, (one per cent) the magnitude of that remaining. Is only slightly less than 
estimates for variation remaining between scnools In other similar cross-sect'onal 
analyses (Willms 1987). 

The very large contribution of the prior-attainment measures in explaining 
educational outcomes at the end of compulsory schooling is not surprising and has 
been seen in other studies of similar data (Wiiims 1986: 1967). That it also explains 
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such a large proportion of the variation between neighbourtioods may be partly due to 
the small sample sizes within neighbourhoods. This means that the 
Intra-ntighbourhood correlations are small and that a targe proportion of the 
batween-nelghbourhood variation Is contributed by the within -neighbourhood 
variation. For tKairpte In the extreme case where there is only one individual in a 
higher level unit (neighbourhood) the withln-neighbourhood variation Is totally 
confounded with the between-neighbourhood variation and no separate estimates are 
possible (Goldstein 1987). As we get more higher level units wit/i fewer Individuals 
within them we begin to approach the situation of a single level analysis, and indeed 
OLS regression estimates become more reliable under these circumstances. The 
statistical significance of any neighbourhood effect however, relies more on the 
number of neighbourhoods than on the number of Individuals within them 
(Raudenbush and Bryk 1986) therefore we are erring on the side of statistical safety 
using EDs rather than some other arbitrary larger-scale spatial grouping. 

Given that our prime interest Is in assessing the contribution of processes which 
are occurring at the neighbourhood level after we have controlled for Individual-level 
variation, we take this model (Model 2) as our base model for comparative purposes. 
Model 3 adds school groups at the Individual level and, the deprWatlon score at the 
higher level. None of the school groups contribute to the explanation of variations in 
educational attainment between neighbourhoods, therefore they can be dropped 
without detriment to the fit of the model leaving the final best-fit model as Model 4. 
This does not mean that schools are unimportant In terms of contributing to 
variations In attainment but at the neighbourhood level (ED) we do not have sufficient 
variability In schooling or power In the data to detect school Influences. This Is a 
problem of attenuated variance at the neighbourhood level. The small number of 
observations within each ED and the fact that In many nelghbourtioods all pupils 
attend the same school means that there Is a degree of co-linearlty between schools 
and neighbourhoods. This Is reflected in a comparison of the coefficients In Models 3 
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and 4 which show virtually no change for the Individual and family variables when 
schools are removed from the model but an Increase in the coefficient for 
neighbourhood deprivation, at the neighbourhood level. This coe'flclent shows the 
importance of neighbourhood deprivation In explaining the mean neighbourhood 
attainment (intercept) given that we have controlled ror individual and family 
background. Deprivation explains around 20 per cent of the unexplained 
neighbourhood variation. The remaining unexplained variation In the model remains 
statistically significant which means that there are processes affecting educational 
attainment at the neighbourhood level which we cannot capture with our existing 
model. 

If we examine the parameter estimates from Model 3 or Model 4 we see that at an 
Individual level, those young people whose fathers are In higher social class groupings 
have a positive advantage for their educational outcomes. Mother's and father's 
education beyond 15 years also has a substantial positive effec! on educational 
outcomes. Father's education Is marginally more important, but mother's education 
has a strong positive effect Independent and additive of father's education For 
children's attainment the added advantage of each parent being educated beyond 15 
years Is approximately equivalent to one additional 0 grade pass at A-C. Being a 
member of a targe family or coming from a single parent family or a family where the 
father Is currently unemployed all have a negative effect on attainment, ahhough 
tether's current employment status Is not statistically significant and was dropped 
from the final model (Model 4). Being female has a positive effect on secondary 
school attainment however, tne most Important predictors of attainment at 
school-leaving age are the measures of prior attainment at the age of twelve. 

The parameter estimates for the deprivation score show that deprivation In the 
home neighbourhood has a negative association with educational attainment even 
after stringently controlling for varlabtlllty at the level of the Individual. For two pupi;s 
with identical prior-attainment scores and family background characteristics, attending 
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the same schooJ. the differences In their educational outcomes associated with 
differences In neighbourhood deprivation may be greater than 1 0 -grade pass (this Is 
the difference associatod with a change In the level of deprivation from the lOlh to 
the 90lh percentile in the present study area). Further real world examples will help 
to Illustrate that although the total variation in educational outcomes to be explained 
by neighbourhood deprivation appears small the deprivation effect Is not trivial. 
School catchments vary considerably in terms of their average levels of 
neighbourhood deprivation. For example In the education authority under study, one 
school has an average catchment deprivation of '•^0377 while another school has an 
av^age of -0 492. A difference of this magnitude In ihe level of deprivation gives a 
predicted attainment differential, for two pupils who are otherwise Identical, of up to 
one 0 grade pass at A to C. 

Average catchn<ent scores obviously obscure the variation within any one school 
catchment. Figure 1 illustrates that not only do schools vary In their average^lavels of 
deprivation but that the range of Intakes may also vary. In school number one for 
example three pupils come from a neighbourhood (ED A) with a deprivation score of 
-0.584 while SIX pupils come from a nelghbourtiood with a score of (ED B). If 

these pupils have identical profiles on prior- attainment and family background 
variables then the model would predict thtt the three pupils from neighbourtiood A 
would have attainment scores of 0.09 of a standard deviation higher than the sU 
pupils from neighbourtiood B. This Is almoM equivalent to an extra 0 grade award at 
A to C and Is the differential associated so'.ely with neighbourtiood deprivation. Other 
schools show greater differentials, with the maximum predicted differential being 
greater than two 0 grades. All other factors are held constant and assumed to be 
equal, which clearly they are not. Young pdople who live In socially deprived areas are 
more than likely to be multiply deprived, first through their home circumstances, 
second through where they live and third through the "contextual* effect of their 
schooling It should be remembered also that the deprivation effect which we are 
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measuring here Is one which has had the effect of deprivation on attainment before 
the age of twelve removed. The prior-attainment measures are likely to Incorporate 
deprivation (and many other) affects from earlier childhood and we are therefore being 
conservative In our estimates of the magnitude of the deprivation effect. We are 
essentially measuring the effects of neighbourhood deprivation (and other background 
factors) on attainment solely during the period of secondary schooling. 

SCHOOLHl£VEL MODELS 
Table 3 summarises the school-level models fitted to the 1 7 schools In the urban 
areas of the study. In these models, neighbourhood effects are restricted to the 
Influence of deprivation as an indlvldual-level variable. This means that essentially we 
are Ignoring the clustering of Individuals within neighbourhoods and may be biasing 
our estimates of the deprivation coefficients. A similar series of models to those for 
neighbourhoods Is fitted. The random effects ANOVA model (Model 1) allows us to 
estimate that some nine percent of the unconditional variation In educational 
outcomes Is between schools. This Is lower than found In other studies of similar 
data, however we have a restricted subset of schools with no schools serving rural 
areas. The lower variability between schools than between neighbourhoods Is partly 
due to differences In levels of aggregation. Schools are larger aggregations of 
individuals therefore there Is likely to be a greater variability within schools than 
within neighbourhoods and correspondingly less variation between schools. Model 2, 
again provides our base for comparative purposes. Neighbourhood deprivation |s 
introduced as an Individual-level variable In Model 3. This Is problematic for 
Interpretation because we must Introduce deprivation, allowing the slope to vary 
between schools (a random effect). This requires that the variable Is censed around 
its mean for each school and that mean level of deprivation for the school Is 
introduced at the school level to avoid mls-lnterpretatlon of the effect. 

The coefficient for the "average' effect of deprivation within schools Is very much 
larger than the coefficient obtained from the neighbourhood model as can be seen 

Pi 
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from tha pradlcted attainment dlffarentlalt within schools shown In Hgura 2. The 
doubSIng of tha coafflclant for naighbourhood deprivation In the school-lever models 
may ba because of bias Introduced by Ignoring the clustering of individuals within 
neighbourhoods but It may £lso ba because neighbourhood deprivation here Is 
capturing part of the school conte^us^ effect. In the school-level models the 
deprivation score of each ED, because H Is attributed to Individuals, Is taken to have 
the same relationship to attainment for ail Individuals In an ED although its effect is 
allowed to vary within schools. Obviously the Ideal situation wodid ba where the 
relationship could vary both within neighbourhoods and schools. Taking the two ^ets 
of analysos together leads us to the conclusion that both neighbourhoods and schools 
must ba taken Into account In examining educational disadvantage. 

Mean level of deprivation at the school-level is not statistlcaly signlflcant In 
predicting variability between the Intercepts for schools although when fitted In a 
modal where the deprivation effect Is constrained to be the same within eech school 
It has a significant and positive effect on mean school attainment This, together with 
the smalt posHiva (all ba H non- significant) affect found hare provides some evidence 
to support the fact that compensatory policies In schools with high levels of 
deprivation are having an ameliorating effect on pupils' attainment In those schools. 

The interpretation of this modal however remains problematic since we era 
attributing an area variable to Individuals. The school-la vet analysis was performed as 
a cross-check to the analysis In the. neighbourhood models. The feci that deprlvetlon 
retains Its significant negative association with attainment mak^s us more confident 
that we have evidence of a neighbourhood deprivation effect 

SUMMARY AND DISCUSStON 
Wa are now In a position to reflect on how well we have established that there 
are neighbourhood and neighbourhood-deprivation affects on educational attainment 
By using the new technique of hierarchical linear modelling wa have been able to 
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show that thare is a substantial variation In educational attainment between 
neighbourhoods but that when we control for prior attainment and family bacicground 
we explain almost all of that variation. We argue however that by controlling for 
pupil-attainment at entry to secondary school we are underestimating the total effect 
of neighbourhood deprivation on attainment The unexplained variation is statisticatiy 
significant and Important. Although W appears a small amount, this should not be 
interpreted as being unimportant (or Impossible) to tackle through policy Initiatives. 
An Important amount (20 per cent) of the remaining variation between 
neighbourhoods was explained by neighbourhood deprivation Even with our 
extremely stringent Individual-level specification the predicted variations In 
educational attainment which ere essoclated with neighbourhood deprivation [ceteris 
paribus may be greater than one 0 grade at A-C. This may seem trivial but It must 
be remembered that this effect Is additional to the effects from individual and family 
background Influences and when translated Into employment prospects, may be of real 
significance In determining the future ilfe-chsnces of young people We should also 
remember that the present study erea has on everage a lower level of deprivation 
than the everege for Scotland and Is more homogeneous. The effect of 
neighbourhood deprivation In some of Scotland's more deprived local-authority 
housing estates In the cities of Glasgow and Edinburgh will be correspondingly 
greater. 

The negative essociation of deprivation with educational outcomes highlights a 
real cause for concern. Targettlng schools In socially deprived areas wlli alleviate 
some educational disadvantage, however, tackling the social deprivation itself. In such 
areas would also have e substantial effect. The use of HLM ellowed us to show that 
the variation between neighbourhoods left unexplained by neighbourhood deprivation 
Is also statistically significant and substantively Important suggesting that there ere 
processes working at the neighbourhood level, contributing to attainment which we 
are unable to explain by our existing model and which require further investigation. 
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This was despite the smaii scale areal units which we were taking to represent 
neighbourhoods in the present study. 

By running comparable analyses at a school level we were able to get some 
estimation of the deprivation effect within schools This two-w»y estlmaiic*^ allows 
some notional 'confidence intervals' to be placed around the deprivation effect, 
although Ideally we look forward to the time when the software will be available to 
permit a cross -classified analysis of schools and neighbourhoods. 

The findings here have crucial Importance In at least two areas where policy 
changes are currently being proposed. First, In the area of measuring school 
effectiveness and the proposed introduction of national testing and school 
performance indicators (Black 1988), where It is clear that local deprivation and 
neighbourhood effects have an Important association with educational outcomes and 
should bd taken into account. If schools are assessed with only some vague attention 
being paid to catchment characteristics then the judgement of school performances 
will be flawed. To totally ignore the wider socio-economic structure In which the 
scrtool Is situated, as proposed recently (Mortlmore 1988; Wilby 1988) would lead to 
gross misinterpretation (Willms 1987; Goldstein and Cuttance 1988). To take account 
of it, as some vague 'average' for some Increasingly 'vague' catchment^ would be 
potentially as dangerous If policy-makers and assessors are determined to measure 
school performance they must' follow Willms' plea for rigorous model specifications 
improved data, and correct statistical analyses <Willms 1987), otherwise they wilt only 
serve to mislead and confuse. 

Second, findings here should prove of Interest to policy makers who are 
addressing the problem of educational disadvantage. The preseiit study has not been 
able to further either the conceptualisation or the theoretical understanding of the 
process of educational disadvantage. What It has achieved is a contribution to the 
developing theory of educational attainment. We have reinforced the knowledge that 
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the sources of educational disadvantage are not singular. They are multivariate and 
they are multhlevel. We have been able to provide an illustralion of the potential of 
multi-level analysis for future Investigations In this area. By using appropriate 
IndivlduaHevel data In conjunction with area-based data and by taking account of this 
structure in a multi-level analysis we have been able to show the potential for 
answering long standing questions relating to educational performance. We have only 
begun to disentangle the Influence of neighbourhoods and social deprivation on 
attainment. The effects we have shown here need to be subjected to more detailed 
analysis. It may be that by combining the various area-level variables into a single 
index of deprivation that we have conflated opposing effects on attainment. More 
work Is needed to Investigate the Influence of specific area-level variables on 
educational attainment. 

Much more a'so needs to be done to examine the effect of social deprivation on 
childrei:'s attainment through time. We examined the effect during the years of 
secondaiy schooling but It may be assumed from other studies that much of the 
effect Arill be on younger children and therefore masked here by our primary school 
attainment measures. These more detailed studies are essential pre-requisltes to the 
successful development of policies to alleviate educational disadvantage. 
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NOTES 

1. TItt Small Ana Statlttlcs for tht 1981 Cansus of Population ara 
madt avallabit to rastarchtrt through tha Edinburgh Unlvarslty 
Data Library. Copyright of thast data Is vajtad In HM Stationary 
Offica on bahalf of tha Crown, and may not ba raproductd without 
parmlttlon. Tha i5ata wara accatsad through tha computer 
packaga SASPAC. Edinburgh Unlvarslty Data Library also provlda 
accass to tha Pottcoda Directory for data linkage via software 
written and maintained by them. 

2. The prior-attainment variables are outcomes on the Moray House 
Verbal Reasoning Test and Reading tests (Oodfray Thomson Unit 
1973). The timed group test (45 minutes) Includes 100 Hems. 

3. The variation between neighbourhoods (tha Intra-class correlation) 
Is calculated using the formula: 

^ - T/(T ♦ o) 

which Is equivalent to: between group varla..ca/betwren group 

variance plus the within group variance. 

From this model we get the following estimate: 

0.1852/(0.1852 ♦ 0.84S0) 

• 0.1852/1.0302 

• 17.98%. 

4. Scaled TOTSCEP values with their equivalent qualification levels: 

'2.03 'No awards' 

-0.63 '0 grade D or E' 

'0.24 '1 0 grade .A to C 

0.08 *2 0 grades A to C 

0.31 3 0 grades A to C 

0.51 '4 0 grades A to C 

0.67 0 grades A to C 

0.85 '6 O grades A to C 

1.08 '1 HIghers pass' 

1.35 *Z HIghers passes' 

O ? 
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1.64 '3 Highers passes' 

204 '4 HIghers passes' 

2.76 '5 HIghers passes' 

4.41 '6 Highers passes' 



5. Parental choice of schooling h6s meant that school catchments 
can no longer be defined In 'de-jure' terms on a map. De-facto" 
catchments may have dramatically different spatial and social 
characteristics from those originally designed by the education 
authority. 
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Tabia 1 Oaprivation icort: conititutnt varlamas 



Socio-damographic Indicators: 

1. Singla-parant famiilas - housariolds containing at Itast ona slngit-ptrtnt family 
witri dapAndant cr)lid(r«n) as a parc«ntaga of ail riousaridds 

2. Larga riousariotds - riousariolds wltri four or mora crilidran as a parcantaga of all 

households 

3. * Eldarty households ' households contelning persons of pensionable age only as 
a percentage of all households 



Economic indicators 

4. Unemployment - economically active residents aged 16 or more seeking work as 
a percentage of economically active residents of the same age 

5. Youth unemployment - •conorolcaUy active residents aged 16-20 seeking work as 
a percentage of economically active residents aged 16 or more 

6. The permanently sick - residents aged 16^ who are permanently sick as e 
percentage of all residents aa«d 16^ 

7. Low earning socio-economic groups - residents economically active or retired 
who are classified by the Rer^Mrar Oanaral Into socio-economic ^oups 7, 10, 11, 
IS or 17 as a percentage of all residents who are economically active or retired 



Housing Indicators 

8. * Amenity deficiency - households without exclMslve use of either e bath or an 
Inside WC or both as a percentage of aH households 

9. Overcrowding - households below the occupancy norm as a percentage of all 

households 

10. * Vecant dwellings - household speces classified in tha Census as 'other* vecants 
as e percentege of total household spaces 

11. * Level end access (1): The very elderly - elderty households containing at laast 
one person eged 75^ on the first floor or ebove with no lift for eccess as e 
percentage of all households 

12. Level and access (2): The under-flves - households containing at least one person 
aged 0-4 on the first floor or above as e percentage of all households. 



* these four variables have very small weightings and therefore have 
comparatively little impact on the deprivation score. 



Source: Based on Duguid and Grant (1983) 
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School HLM eodels of SCS attaineent 



Fixed Effects 



Model 1 



Model 2 



Model 3 



Hi thin-school equations Effect se z 
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Mean atcainnent .021 .076 0.27 


-.018 


.031 


-0.59 


-.027 
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Prior attaiisent 
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.002 


12.93 


Prior reading ability 


.026 


.002 


13.72 


.026 


.002 


13.46 


Sex 


.059 


.031 


1.88 


.063 


.031 


2.02 


Father*s social class 


.011 


.001 


7.35 


.009 


.001 


6.35 


Father's education 


.204 


.046 


4.48 


.196 


.045 


4.35 


Father unemployed 


-.137 


.052 


-2.65 


-.113 


.051 


-2.20 


Mother's education 


.111 


.042 


2.66 


.104 


.041 


2.52 


Nujaber of siblings 


-.061 


.012 


-5.26 


-.053 


.012 


-4.54 


Single parent faoily 


-.130 


.046 


-2.85 


-.089 


.045 


-1.95 


Neighbourhood deprivation 








-.205 


.031 


-6.50 


Effects of Between school variables 














tMean school deprivation 








.076 


.104 


0.73 


Variation Botueen Schools 














Est X df 


Est 


X 


df 


Est 


X 


df E. 



Paraieter variance 
Observed variance 
Reliability 

Npdel. Statistics 

tMaxiiflun - likelihood 
eslioate of (T 



.0913 206.68 16 

.09S8 

.924 



.956 



X df 

.0044 302.03 16 .0043 312.52 16 .001 207.78 15 



.0099 
.442 



.567 



.0097 
.443 



.556 



.028 
.023 



Fi gure 1 

Predicted Attainment Differentials 
by Neighbourhood Model 
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Fi gure 2 

Predicted Attainment Differentials 
b y Schools Model 
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